

comparing results from different human language models at approximately the 
same time to generate an integrated time ordered index of the identified attributes. 

2. The method of claim 1 , further comprising: 

comparing confidence ratings of the different human language models. 

3. The method of claim 1 , further comprising: 

generating a transcript including each spoken word, wherein each spoken word 
shares the common time reference. 

4. The method of claim 1 , further comprising: 

triggering an event to occur upon an identification of unique voice characteristics 
of a speaker in less than five seconds. 



^ (Amended) A machine-readable medium that stores instructions, which when 
executed by a machine, cause the machine to perform operations comprising: 

identifying attributes including one or more types of accents and one or more 
types of human languages from an audio information stream; 

encoding each identified attribute from the audio information stream into a time 
ordered index, each of the identified attributes sharing a common time reference; 

comparing results from different human language models at approximately the 
same time to generate an integrated time ordered index of the identified attributes. 
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6. The article of manufacture of claim 5, further comprising instructions which cause 
the machine to perform further operations comprising: 

generating a query on one or more of the identified attributes in the time ordered 
indexed. 

7. (Amended) The article of manufacture of claim 6, further comprising instructions 
which cause the machine to perfomn further operations comprising: 

correlating a first identified attribute of the information stream with a second 
identified attribute having a similar time code. 

8. The article of manufacture of claim 5, wherein the audio information stream comes 
from an unstructured information source. 

9. The article of manufacture of claim 5, wherein the audio information stream includes 
audio-visual data. 

10. The article of manufacture of claim 5. wherein the audio information stream 
includes speech data. 

1 1 . The article of manufacture of claim 5, wherein at least one of the identified 
attributes further comprises a change of accent. 

12. The article of manufacture of claim 5, wherein at least one of the identified 
attributes further comprises a change of human language. 
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1 3. The article of manufacture of claim 5, wherein at least one of the identified 
attributes further comprises a discrete spoken word. 

14. The article of manufacture of claim 5, wherein the identified attributes are encoded 
via extensible markup language. 

15. The article of manufacture of claim 5, wherein the time ordered index includes a 
start time and a duration in which each identified attribute was conveyed. 

16. The article of manufacture of claim 5, wherein the common time reference 
comprises a time indication. 

17. The article of manufacture of claim 5, wherein the common time reference 
comprises a frame count. 

18. The article of manufacture of claim 5, further comprising instructions which cause 
the machine to perform further operations comprising: 

correlating a first identified attribute of the infomnation stream with a second 
identified attribute having a similar time code. 

19. The article of manufacture of claim 18, wherein the similar time code comprises the 
first identified attribute possessing a start time approximately the same as the second 
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identified attribute or an overlapping of the durations associated witfi the first identified 
and the second identified attribute. 

20. The article of manufacture of claim 5. wherein the integrated time ordered index 
includes data from the different human language models. 



means for identifying attributes including one or more types of accents and one 
or more types of human languages from an audio information stream; 

means for encoding each identified attribute from the audio information stream 
into a time ordered index, each of the identified attributes sharing a common time 
• reference; and 

means for comparing results from different human language models at 
approximately the same time to generate an Integrated time ordered index of the 
identified attributes. 

22. The apparatus of claim 21 , further comprising: 

means for generating a query on the one or more identified attributes in the time 
ordered indexed. 



29^A machine-readable medium that stores instructions, which when executed by a 
machine, cause the machine to perform operations comprising: 

converting spoken words in an information stream to written text, the information 
stream containing audio information; and 




(Amended) An apparatus, comprising: 
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generating a separate encoded file for every word, wherein eacli encoded file 
shares a common time reference. 

24. The article of manufacture of claim 23, further comprising instructions which cause 
the machine to perform further operations comprising: 

generating a link to relevant material based upon the spoken words and 
synchronizing a display of the link in less than five seconds from analyzing the 
information stream. 



^ (Amended) An apparatus comprising: 

a software engine having one or more attribute filters to detect attributes from an 
• audio information stream, identify the attributes, and assign a time ordered indication 
with each of the identified attributes, the software engine having an index control 
module to facilitate an integrated time order indexing of the identified attributes; and 
a computer readable medium to store the software engine. 

26. The apparatus of claim 25, wherein the time ordered Indication comprises a start 
time and a duration in which the attribute was conveyed. 

27. The apparatus of claim 25, wherein the one or more attribute filters generate a time 
ordered Index of the audio infomnatlon stream in real time. 

28. The apparatus of claim 25, wherein the audio infomnation stream passes through 
the one or more attribute filters a single time. 




Application No.: 10/060,579 



6 



Docket No. 005827. P002 




29. The apparatus of claim 25, further comprising: 

a manipulation module to perform operations on a first set of attributes in order 
to manipulate a second set of attributes. 

30. The apparatus of claim 29, wherein the first set of attributes compromises a section 
of transcripted text and the second set of attributes comprises video images having 
approximately the same time ordered indications as the transcripted text. 



a triggering and synchronization module to dynamically trigger a link and 
• synchronize the appearance of the link based upon a transcripted text from the 
information stream. 



31 . The apparatus of claim 25, further comprising: 
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